Neural Codes and Independent Component Analysis: Information Theoretic Approach and Conditions on Cumulants
نویسنده
چکیده
In this contribution we review recent results obtained on blind source separation (BSS) and independent component analysis (ICA). In particular we show that maximi-sation of mutual information can lead to ICA, and we present new conditions on cross cumulants which guarantee that blind source separation has been performed.
منابع مشابه
I.C.A.: conditions on cumulants and information theoretic approach
In this contribution we present new conditions on cross cumulants which guarantee that blind source separation has been performed , and we relate these conditions to the maximization of mutual information as a criterion for ICA.
متن کاملSource Separation, ICA via Unsupervised Learning: Information-theoretic Approach and Conditions on Cross-cumulants
The problem of separation of independent source signals from their instantaneous mixtures, is addressed by using two diierent approaches: (1) information-theoretic approach; (2) higher-order cross-cumulants approach. Natural gradient 4] is known as eecient and fast convergent for on-line learning. First, we present further results on natural gradient-based source separation algorithms. Second, ...
متن کاملRedundancy Reduction and Independent Component Analysis: Conditions on Cumulants and Adaptive Approaches Submitted to Neural Computation
In the context of both sensory coding and signal processing, building fac-torized codes has been shown to be an eecient strategy. In a wide variety of situations, the signal to be processed is a linear mixture of statistically independent sources. Building a factorized code is then equivalent to performing blind source separation. Thanks to the linear structure of the data, this can be done, in...
متن کاملFeature Extraction Through LOCOCODE
Low-complexity coding and decoding (LOCOCODE) is a novel approach to sensory coding and unsupervised learning. Unlike previous methods, it explicitly takes into account the information-theoretic complexity of the code generator. It computes lococodes that convey information about the input data and can be computed and decoded by low-complexity mappings. We implement LOCOCODE by training autoass...
متن کاملLow-Complexity Coding and Decoding
We present a novel approach to sensory coding and unsu-pervised learning. It is called \Low-complexity coding and decoding" (Lococode). Unlike previous methods it explicitly takes into account the information-theoretic complexity of the code generator: lococodes (1) convey information about the input data and (2) can be computed and decoded by low-complexity mappings. To implement Lococode we t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007